Image forming apparatus with registered correct answer image to verify printed image, image forming method, and storage medium

ABSTRACT

An image printed on a recording sheet is read, and read images excluding a defective image are displayed on a display unit. An instruction to use a displayed image as a correct answer image is accepted, and an image generated from the accepted image is registered as a correct answer image to be used for verification.

BACKGROUND Technical Field

One disclosed aspect of the embodiments relates to an image formingapparatus with verification of a printed image, an image forming method,and a storage medium.

Description of the Related Art

A printing system has been known in recent years that can verify a sheetprinted by a printer with a verification apparatus during conveyance. Toverify a printed sheet, the verification apparatus reads an image on theconveyed printed sheet and determines whether the printed sheet isnormal based on image analysis of the read image. For example, theverification apparatus can detect an incomplete barcode or ruled line, amissing image, a printing failure, a missing page, and a color drift.

As a method for generating a correct answer image (master image orreference image) for image analysis, a method of reading a previouslyprinted sheet having sufficient quality as a correct answer image by averification apparatus and using the read printed sheet has been known.Obtaining the correct answer image by a read sensor of the apparatus tobe used in an actual verification process can reduce verification errorsdue to the conveyance precision of printed sheets and the readingaccuracy of the read sensor.

In obtaining a correct answer image, the printed sheet to be read maydesirably be printed with sufficient quality as a correct answer imageand correctly read by the read sensor. For example, streaks can occur onthe read image because paper dust of the printed sheet adheres to theread sensor of the verification apparatus. If an image including astreak is used as a correct answer image, a printing failure canerroneously be detected even in the absence of a defect in a printproduct. Japanese Patent Application Laid-Open No. 2010-173289 discussesprinting a correct answer image to be registered and a defect detectionpattern on different sheets of paper and reading the defect detectionpattern to confirm the absence of a defect before registering thecorrect answer image.

However, the foregoing streaks due to paper dust can occur duringreading of the sheet with the correct answer image even if not duringthe reading of the sheet with the defect detection pattern. According toJapanese Patent Application Laid-Open No. 2010-173289, an image defectoccurring in the read correct answer image can therefore fail to bedetected. As a result, the image including the image defect can beregistered as a correct answer image.

SUMMARY

According to an aspect of the embodiments, an image forming apparatusincludes a printing unit, a reading unit, a detection unit, a displaycontrol unit, an acceptance unit, a registration unit, and averification unit. The printing unit is configured to print an image ona recording sheet. The reading unit is configured to read the imageprinted on the recording sheet The detection unit is configured todetect a defective image from among images read by the reading unit. Thedisplay control unit is configured to display on a display unit theimages read by the reading unit excluding the defective image detectedby the detection unit. The acceptance unit is configured to accept aninstruction to use an image displayed on the display unit by the displaycontrol unit as a correct answer image. The registration unit isconfigured to register the image that the instruction to use is acceptedby the acceptance unit or an image generated from the image as thecorrect answer image. The verification unit is configured to verify animage printed by the printing unit by comparing the printed image withthe correct answer image registered by the registration unit.

According to another aspect of the embodiments, an image formingapparatus includes a printing unit, a reading unit, an acceptance unit,a registration unit, and a verification unit. The printing unit isconfigured to print an image on a recording sheet, a reading unitconfigured to read the image printed on the recording sheet. The displaycontrol unit is configured to display a plurality of images read by thereading unit on a display unit. The acceptance unit is configured toaccept an instruction to use at least one of the plurality of imagesdisplayed on the display unit by the display control unit as a correctanswer image or an instruction not to use the at least one image as thecorrect answer image. The registration unit is configured to registerthe at least one image that the instruction to use is accepted by theacceptance unit or an image generated from the at least one image as thecorrect answer image. The verification unit is configured to verify animage printed by the printing unit by comparing the printed image withthe correct answer image registered by the registration unit.

According to the disclosure, images read by the reading unit excluding adefective image or images are displayed on the display unit. This canreduce time and effort to select a correct answer image to be used inverification processing.

Further features of the disclosure will become apparent from thefollowing description of exemplary embodiments with reference to theattached drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is an overall view illustrating a hardware configuration of animage processing system according to a first exemplary embodiment.

FIG. 2 is a block diagram illustrating a system configuration of theimage processing system according to the first exemplary embodiment.

FIG. 3 is a schematic diagram illustrating a mechanical sectional viewof an image forming apparatus according to the first exemplaryembodiment.

FIG. 4A is a flowchart illustrating a procedure performed by an externalcontroller in registering correct answer images according to the firstexemplary embodiment.

FIG. 4B is a flowchart illustrating a procedure performed by a printerin registering correct answer images according to the first exemplaryembodiment.

FIG. 5 is a flowchart illustrating a procedure performed by averification apparatus in registering correct answer images according tothe first exemplary embodiment.

FIG. 6 is a flowchart illustrating a procedure performed by theverification apparatus in performing verification processing accordingto the first exemplary embodiment.

FIG. 7 illustrates an example of a display screen before registration ofcorrect answer images in the verification apparatus according to thefirst exemplary embodiment.

FIG. 8 illustrates an example of a display screen when the verificationapparatus initiates registration of correct answer images according tothe first exemplary embodiment.

FIG. 9 illustrates an example of a display screen when the verificationapparatus is reading correct answer images according to the firstexemplary embodiment.

FIG. 10 illustrates an example of a display screen after the reading ofthe correct answer images by the verification apparatus according to thefirst exemplary embodiment.

FIG. 11A illustrates an example of a display screen after theregistration of correct answer images in the verification apparatusaccording to the first exemplary embodiment.

FIG. 11B illustrates an example of a display screen after theregistration of correct answer images in the verification apparatusaccording to the first exemplary embodiment.

FIG. 12 illustrates an example of a display screen when the verificationapparatus makes verification settings according to the first exemplaryembodiment.

FIG. 13 illustrates an example of a display screen when the verificationapparatus makes a determination of verification success according to thefirst exemplary embodiment.

FIG. 14 illustrates an example of a display screen when the verificationapparatus makes a determination of verification failure according to thefirst exemplary embodiment.

FIG. 15 illustrates an example of a display screen when the externalcontroller makes verification job settings according to the firstexemplary embodiment.

FIG. 16 is a flowchart illustrating a procedure performed by averification apparatus in performing verification processing accordingto a second exemplary embodiment.

FIG. 17 illustrates an example of a display screen when the verificationapparatus initiates registration of correct answer images according tothe second exemplary embodiment.

FIG. 18 illustrates an example of a table for managing defectinformation according to the second exemplary embodiment.

FIG. 19 illustrates an example of a display screen after reading ofcorrect answer images by the verification apparatus according to thesecond exemplary embodiment.

FIG. 20A illustrates an example of stray streak pixels according to thesecond exemplary embodiment.

FIG. 20B illustrates an example of vertical line pixels in a documentaccording to the second exemplary embodiment.

DESCRIPTION OF THE EMBODIMENTS

Exemplary embodiments of the present exemplary embodiment will bedescribed below with reference to the drawings.

In the following description, an external controller may be referred toas an image processing controller, a digital front end (DFE), or a printserver. An image forming apparatus may be referred to as a multifunctionperipheral (MFP).

First Exemplary Embodiment

FIG. 1 is an overall view illustrating a hardware configuration of animage processing system according to the present exemplary embodiment.The image processing system includes an image forming apparatus 101 andan external controller 102. The image forming apparatus 101 and theexternal controller 102 are communicably connected via an internal localarea network (LAN) 105 and a video cable 106. The external controller102 is communicably connected to a client personal computer (PC) 103 viaan external LAN 104. The client PC 103 issues print instructions to theexternal controller 102.

A printer driving having a function of converting print data into aprint description language processible by the external controller 102 isinstalled on the client PC 103. A user who performs printing can giveprint instructions from various applications via the printer driver. Theprinter driver transmits print data to the external controller 102 basedon the print instructions from the user. Receiving the printinstructions from the client PC 103, the external controller 102performs data analysis and rasterization processing, and submits printdata and issues print instructions to the image forming apparatus 101.

Next, the image forming apparatus 101 will be described. The imageforming apparatus 101 includes a plurality of apparatuses havingdifferent functions. The apparatuses are connected and configured suchthat complicated print processing such as bookbinding can be performed.

A printer 107 forms an image with toner on a sheet conveyed from a sheetfeed unit located in a lower part of the printer 107. A configurationand operation principle of the printer 107 will be described. Aphotosensitive drum is irradiated with scanning light that is obtainedby reflecting a beam of light such as laser light, modulated based onimage data, with a rotating polygonal mirror. An electrostatic latentimage formed on the photosensitive drum by the laser light is developedwith toner, and the resulting toner image is transferred to a sheetattached to a transfer drum. Such a series of image forming processes isperformed with yellow (Y), magenta (M), cyan (C), and black (K) tonersin succession, whereby a full color image is formed on the sheet. Thesheet on the transfer drum on which the full color image is formed isconveyed to a fixing device. The fixing device includes a roller and abelt. The roller includes a heat source such as a halogen heater inside,and melts the toner on the toner image-transferred sheet and fixes thetoner to the sheet by heat and pressure.

An inserter 108 is an apparatus for inserting insertion sheets. Theinserter 108 can insert sheets into between given sheets in a group ofsheets printed and conveyed by the printer 107.

A verification apparatus 109 is an apparatus for reading an image of theconveyed sheet and comparing the image with a correct answer imageregistered in advance to determine whether the printed image is normal.

A large capacity stacker 110 can stack a large volume of sheets. Afinisher 111 applies finishing processing to the conveyed sheets. Thefinisher 111 can perform finishing processing such as stapling,punching, and saddle stitch bookbinding. The finisher 111 discharges thebookbinding products after the finishing processing to a discharge tray.

The inserter 108 and the verification apparatus 109 are not limited tothe positions of FIG. 1 in order. The inserter 108 may be locatedbetween the verification apparatus 109 and the large capacity stacker110.

The image processing system illustrated in FIG. 1 is configured suchthat the external controller 102 is connected to the image formingapparatus 101. However, the present exemplary embodiment is not limitedto the configuration where the external controller 102 is connected.Specifically, the image forming apparatus 101 may be connected to theexternal LAN 104, and print data processible by the image formingapparatus 101 may be transmitted from the client PC 103 to the imageforming apparatus 101. In such a configuration, the image formingapparatus 101 analyzes data and performs rasterization processing toperform print processing.

FIG. 2 is a block diagram illustrating a system configuration of theimage forming apparatus 101, the external controller 102, and the clientPC 103.

A configuration of the printer 107 of the image forming apparatus 101will initially be described. The printer 107 of the image formingapparatus 101 includes a communication interface (I/F) 217, a LAN I/F218, a video I/F 220, a hard disk drive (HDD) 211, a central processingunit (CPU) 222, a memory 223, an operation unit 224, and a display 225.The printer 107 of the image forming apparatus 101 further includes adocument exposure unit 226, a laser exposure unit 227, an image formingunit 228, a fixing unit 229, and a sheet feed unit 230. Such componentsare connected via a system bus 231.

The communication I/F 217 is connected to the inserter 108, theverification apparatus 109, the large capacity stacker 110, and thefinisher 111 via communication cables 254, and performs communicationfor controlling the apparatuses. The LAN I/F 218 is connected to theexternal controller 102 via the internal LAN 105, and communicates printdata. The video I/F 220 is connected to the external controller 102 viathe video cable 106, and communicates image data.

The HDD 221 is a storage device storing programs and data. The CPU 222performs image processing control and print control based on theprograms stored in the HDD 221. The memory 223 stores programs to beused when the CPU 222 performs various types of processing, as well asimage data. The memory 223 operates as a work area. The operation unit224 accepts various setting inputs and operation instructions from theuser. The display 225 displays setting information about the imageforming apparatus 101 and a processing status of print jobs.

The document exposure unit 226 performs processing for reading adocument when a copy function or a scan function is used. The documentexposure unit 226 reads document data by illuminating a sheet placed bythe user with an exposure lamp and detecting an image with acomplementary metal-oxide-semiconductor (CMOS) image sensor or a contactimage sensor (CIS). The laser exposure unit 227 is a device thatperforms primary charging intended to irradiate the photosensitive drumswith laser light to form toner images, as well as laser exposure. Thelaser exposure unit 227 initially performs primary charging to chargethe surfaces of the photosensitive drums to a uniform negativepotential. A laser driver then irradiates the photosensitive drums withlaser light while the polygonal mirror adjusts reflection angles.Negative charges on the irradiated portions are thereby neutralized toform electrostatic latent images. The image forming unit 228 is a devicefor transferring toner to a sheet. The image forming unit 228 includesdeveloping units, transfer units, and toner replenishment units, andtransfers toner on the photosensitive drums to a sheet. The developingunits make negatively-charged toner on developing cylinders adhere tothe electrostatic latent images on the surfaces of the photosensitivedrums to form visible images. The transfer units perform a primarytransfer and a secondary transfer. In the primary transfer, a positivepotential is applied to primary transfer rollers to transfer the toneron the surfaces of the photosensitive drums to a transfer belt. In thesecondary transfer, a positive potential is applied to a secondarytransfer outer roller to transfer the toner on the transfer belt to thesheet. The fixing unit 229 is a device for melting the toner on thesheet and fixing the melted toner to the sheet by heat and pressure. Thefixing unit 229 includes a heater, a fixing belt, and a pressure belt.The sheet feed unit 230 is a device for feeding sheets. A sheet feedoperation and conveyance operation are controlled by using rollers andvarious sensors.

Next, a configuration of the inserter 108 of the image forming apparatus101 will be described. The inserter 108 of the image forming apparatus101 includes a communication I/F 232, a CPU 233, a memory 234, and afeed control unit 235. Such components are connected via a system bus236. The communication I/F 232 is connected to the printer 107 via acommunication cable 254, and performs communication for control. The CPU233 performs various controls for feeding sheets based on controlprograms stored in the memory 234. The memory 234 is a storage devicestoring the control programs. The feed control unit 235 controls rollersand sensors while controlling feeding and conveyance of sheets conveyedfrom a sheet feed unit of the inserter 108 and from the printer 107based on instructions from the CPU 233.

Next, a configuration of the verification apparatus 109 of the imageforming apparatus 101 will be described. The verification apparatus 109of the image forming apparatus 101 includes a communication I/F 237, aCPU 238, a memory 239, an imaging unit 240, a display unit 241, and anoperation unit 242. Such components are connected via a system bus 243.The communication unit I/F 237 is connected to the printer 107 via acommunication cable 254, and performs communication for control. The CPU238 performs various controls for verification based on control programsstored in the memory 239. The memory 239 is a storage device storing thecontrol programs. The imaging unit 240 reads an image printed on aconveyed sheet with a CIS based on instructions from the CPU 238. Theimaging unit 240 may obtain an image by capturing the image printed onthe conveyed sheet with a camera. The imaging unit 240 reads not onlyprint products to be verified but also a print product that serves as acorrect answer image candidate in registering a correct answer image. Aplurality of copies is printed for each page of the print productserving as a correct answer image candidate. Averages of the pixelvalues of pixels at corresponding positions on the plurality of printedpages are used as the pixel values of the correct answer image. If tencopies are printed, an average of the pixel values of pixels atcorresponding positions on the ten pages (for example, the pixels at thetop left corners of the images) is used as the pixel value of thecorrect answer image. This can reject minute variation componentscorresponding to a verification precision smaller than a verificationprecision in the print products as much as possible.

The CPU 238 compares an image captured by the imaging unit 240 with acorrect answer image stored in the memory 239 (storage unit), anddetermines whether the printed image is normal. The display unit 241displays verification results and setting screens. The operation unit242 is operated by the user and accepts instructions for setting changesof the verification apparatus 109 and registration of a correct answerimage.

Next, a configuration of the large capability stacker 110 of the imageforming apparatus 101 will be described. The large capability stacker110 of the image forming apparatus 101 includes a communication I/F 244,a CPU 245, a memory 246, and a discharge control unit 247. Suchcomponents are connected via a system bus 248. The communication I/F 244is connected to the printer 107 via a communication cable 254, andperforms communication for control. The CPU 245 performs variouscontrols for sheet discharge based on control programs stored in thememory 246. The memory 246 is a storage device storing the controlprograms. The discharge control unit 247 controls conveyance of conveyedsheets to a stacking tray, an escape tray, or the subsequent finisher111 based on instructions from the CPU 245.

Next, a configuration of the finisher 111 of the image forming apparatus101 will be described. The finisher 111 of the image forming apparatus101 includes a communication I/F 249, a CPU 250, a memory 251, adischarge control unit 252, and a finishing processing unit 253. Suchcomponents are connected via a system bus 255. The communication I/F 249is connected to the printer 107 via a communication cable 254, andperforms communication for control. The CPU 250 performs variouscontrols for finishing and sheet discharge based on control programsstored in the memory 251. The memory 251 is a storage device storing thecontrol programs. The discharge control unit 252 controls sheetconveyance and discharge based on instructions from the CPU 250. Thefinishing processing unit 253 controls finishing processing such asstapling, punching, and saddle stitch bookbinding based on instructionsfrom the CPU 250.

Next, a configuration of the external controller 102 will be described.The external controller 102 includes a CPU 208, a memory 209, an HDD210, a keyboard 211, a display 212, a LAN I/F 213, a LAN I/F 214, and avideo I/F 215, which are connected via a system bus 216. The CPU 208performs processing such as reception of print data from the client PC103, raster image processor (RIP) processing, and transmission of printdata to the image forming apparatus 101 based on programs and datastored in the HDD 210. The memory 209 stores programs and data to beused when the CPU 208 performs various types of processing, and operatesas a work area. The HDD 210 stores programs and data to be used foroperations such as print processing. The keyboard 211 is a device forinputting operation instructions to the external controller 102. Thedisplay 212 displays information about execution applications of theexternal controller 102 by using still and/or moving image videosignals. The LAN I/F 213 is connected to the client PC 103 via theexternal LAN 104, and communicates print instructions. The LAN I/F 214is connected to the image forming apparatus 101 via the internal LAN105, and communicates print instructions. The video I/F 215 is connectedto the image forming apparatus 101 via the video cable 106, andcommunicates image data.

Next, a configuration of the client PC 103 will be described. The clientPC 103 includes a CPU 201, a memory 202, an HDD 203, a keyboard 204, adisplay 205, and a LAN I/F 206, which are connected via a system bus207. The CPU 201 generates print data and executes print instructionsbased on a document processing program stored in the HDD 203. The CPU201 also controls the devices connected to the system bus 207 in acomprehensive manner. The memory 202 stores programs and data to be usedwhen the CPU 201 performs various types of processing, and operates as awork area. The HDD 203 stores programs and data to be used for printprocessing operations. The keyboard 204 is a device for inputtingoperation instructions to the client PC 103. The display 205 displaysinformation about execution applications of the client PC 103 by usingstill and/or moving image video signals. The LAN I/F 206 is connected tothe external LAN 104, and communicates print instructions.

In the foregoing description, the external controller 102 and the imageforming apparatus 101 are connected with the internal LAN 105 and thevideo cable 106. However, the external controller 102 and the imageforming apparatus 101 may have any configuration as long as the data tobe used for printing can be transmitted and received. For example, theexternal controller 102 and the image forming apparatus 101 may beconfigured to be connected with only the video cable 106. Moreover, thememories 202, 209, 223, 234, 239, 249, and 251 each may be any storagedevice for storing data and programs. For examples, the memories 202,209, 223, 234, 239, 249, and 251 may be replaced with volatile randomaccess memories (RAMs), nonvolatile read-only memories (ROMs), built-inHDDs, external HDDs, and/or Universal Serial Bus (USB) memories.

FIG. 3 is a mechanical sectional view of the image forming apparatus101. The printer 107 is an apparatus that forms an image to be printedon a sheet. Sheet feed decks 301 and 302 can accommodate various sheets.Each sheet deck can separate only the topmost one of the accommodatedsheets, and convey the sheet to a sheet conveyance path 303. To form acolor image, developing stations 304, 305, 306, and 307 form tonerimages by using Y, M, C, and K color toners, respectively. The tonerimages formed here are primarily transferred to an intermediate transferbelt 308. The intermediate transfer belt 308 rotates clockwise, and thetoner images are transferred to the sheet conveyed from the sheetconveyance path 303 at a secondary transfer position 309. The display225 displays the printing status of the image forming apparatus 101 andinformation for making settings. A fixing unit 311 for fixing the tonerimages to the sheet includes a pressure roller and a heating roller. Thetoner melts and is pressurized when the sheet between the rollers passesd, whereby the toner images are fixed to the sheet. The sheet havingpassed through the fixing unit 311 is conveyed to a conveyance path 315through a sheet conveyance path 312. Depending on the sheet type,additional melting and pressurization may be desirable for the sake offixing. In such a case, the sheet having passed through the fixing unit311 is conveyed to a second fixing unit 313 through an upper sheetconveyance path. After the application of the additional melting andpressurization, the sheet is conveyed to the conveyance path 315 througha sheet conveyance path 314. If the image forming mode is a two-sidedmode, the sheet is conveyed to a sheet reversing path 316. The sheet isreversed by the sheet reversing path 316 and then conveyed to atwo-sided conveyance path 317, and an image transfer is performed on thesecond side at the secondary transfer position 309.

The inserter 108 for inserting insertion sheets incudes an insertiontray 321, and merges sheets supplied through a sheet conveyance path 322into the conveyance path. Sheets can thereby be inserted into a seriesof sheets conveyed from the printer 107 at given positions and conveyedto the subsequent apparatus.

The sheet having passed through the inserter 108 is conveyed to theverification apparatus 109. The verification apparatus 109 includes CISs331 and 332 (reading units) that are opposed to each other. The CIS 331is a sensor for reading the upper surface of the sheet (hereinafter, maybe referred to as recording sheet). The CIS 332 is a sensor for readingthe lower surface of the recording sheet. The image sensors for readingthe sheet surfaces may be line scan cameras instead of CISs. Theverification apparatus 109 reads images on both sides of the recordingsheet with the CISs 331 and 332 at timing when the sheet conveyed to asheet conveyance path 333 reaches a predetermined position, anddetermines whether the images are normal. The display unit 241 displaysthe result of the verification made by the verification apparatus 109.

The large capacity stacker 110 can stack a large volume of sheets. Thelarge capacity stacker 110 includes a stacking tray 341 as a tray forstacking sheets. The sheet having passed through the verificationapparatus 109 is input to the large capacity stacker 110 through a sheetconveyance path 344. The sheet is conveyed from the sheet conveyancepath 344 through a sheet conveyance path 345 and stacked on the stackingtray 341. The large capacity stacker 110 further includes an escape tray346 as a discharge tray. The escape tray 346 is a discharge tray used todischarge sheets determined to be defective sheets by the verificationapparatus 109. In case where a sheet is output to the escape tray 346,the sheet is conveyed from the sheet conveyance path 344 to the escapetray 346 via a sheet conveyance path 347. In a case where a sheet isconveyed to a postprocessing apparatus at a stage subsequent to thelarge capacity stacker 110, the sheet is conveyed through a sheetconveyance path 348. A reversing portion 349 is intended to reverse asheet. The reversing portion 349 is used in stacking a sheet on thestacking tray 341. In a case where a sheet is stacked on the stackingtray 341, the sheet is once reversed by the reversing portion 349 sothat the input orientation and output orientation of the sheet are thesame. In a case where a sheet is conveyed to the escape tray 346 or thepostprocessing apparatus at the subsequent stage, the reversingoperation by the reversing portion 349 is not performed, so that thesheet is simply discharged without flipping for stacking.

The finisher 111 applies finishing processing to conveyed sheets basedon a function specified by the user. Specifically, the finisher 111 hasfinishing functions such as stapling (single stapling and doublestapling), punching (two- and three-hole punching), and saddle stitchbookbinding. The finisher 111 includes two discharge trays 351 and 352.Sheets are output to the discharge tray 351 through a sheet conveyancepath 353. The sheet conveyance path 353 is not capable of stapling orother finishing processing. To performing finishing processing such asstapling, sheets are conveyed through a sheet conveyance path 354 to aprocessing unit 355, where the finishing function specified by the useris performed, and the resulting sheets are output to the discharge tray352. Both the discharge trays 351 and 352 can be moved up and down. Thedischarge tray 351 can be lowered so that sheets given the finishingprocessing by the processing unit 355 are stacked on the discharge tray351. If saddle stitch bookbinding is specified, a saddle stitchprocessing unit 356 applies stapling processing to the center of thesheets. The sheets are then folded in half and output to a saddle stitchbookbinding tray 358 through a sheet conveyance path 357. The saddlestitch bookbinding tray 358 is configured as a belt conveyor. Bundlesbound by the saddle stitch bookbinding are stacked on the saddle stitchbookbinding tray 358 and conveyed to the left.

The verification apparatus 109 verifies a sheet image printed by theprinter 107 based on verification items set in advance. The sheet imageis verified by comparing the printed sheet image with a correct answerimage set in advance. Examples of the method for comparing the imagesinclude comparing pixel values at each image position, comparing objectpositions through edge detection, and extracting character data throughoptical character recognition (OCR). Examples of the verification itemsinclude a misalignment in print position, image color, image density,streaks, blur, and omission.

A procedure of processing for registering a correct answer image and animage verification processing procedure will be described below withreference to FIGS. 4A to 6.

FIG. 4A is a flowchart illustrating a procedure performed by theexternal controller 102 in registering a correct answer image. A programfor performing the flowchart of FIG. 4A is stored in the HDD 210, readinto the memory 209, and executed by the CPU 208.

In step S4001, the external controller 102 determines whether a printinstruction for an N-copy print job is received. If, in step S4001, aprint instruction for an N-copy print job is received (YES in stepS4001), the processing proceeds to step S4002. In step S4002, theexternal controller 102 submits print data on N copies to the printer107 and instructs the printer 107 to perform printing.

FIG. 4B is a flowchart illustrating a procedure performed by the printer107 in registering a correct answer image. A program for performing theflowchart of FIG. 4B is stored in the HDD 221, read into the memory 223,and executed by the CPU 222.

In step S4003, the printer 107 waits until a print instruction isreceived from the external controller 102. If, in step S4003, a printinstruction is received from the external controller 102 (YES in stepS4003), the processing proceeds to step S4004. In step S4004, theprinter 107 prints a job received from the external controller 102.Aside from image data, the job received from the external controller 102includes information about a sheet feed source and a dischargedestination. The printer 107 controls the inserter 108, the verificationapparatus 109, the large capacity stacker 110, and the finisher 111 viathe communication cables 254 based on the contents of the job receivedfrom the external controller 102.

FIG. 5 is a flowchart illustrating a procedure performed by theverification apparatus 109 in registering a correct answer image. Aprogram for performing the flowchart of FIG. 5 is stored in the memory239 and executed by the CPU 238 of the verification apparatus 109.

In step S501, the verification apparatus 109 obtains print settings(setting values). The setting values obtained in step S501 include thenumber of sheets per copy, the side(s) to be verified, and the number ofimages per sheet to average the pixel values in generating a correctanswer image. In step S502, the verification apparatus 109 waits until asheet is conveyed to the verification apparatus 109. If a sheet isconveyed in step S502 (YES in step S502), the processing proceeds tostep S503. In step S503, the verification apparatus 109 reads images onthe sheet by using the CISs 331 and 332, and stores the images in thememory 239 of the verification apparatus 109. In step S504, theverification apparatus 109 determines whether images have been read asmany as the number of sheets obtained in step S501. If, in step S504,images have not been read as many as the number of sheets yet (NO instep S504), the processing proceeds to step S502. If images have beenread as many as the number of sheets (YES in step S504), the processingproceeds to step S505.

In step S505, the verification apparatus 109 generates preview imagesfor providing a preview display of the images read in step S503 on thedisplay unit 241 of the verification apparatus 109. In step S506, theverification apparatus 109 performs display control to display thepreview images on the display unit 241 along with a user interface (UI)screen. Details of the UI screen displayed here will be described belowwith reference to FIG. 10. In step S507, the verification apparatus 109determines whether all the read images are accepted for use as correctanswer images on the UI screen. If all the read images are accepted (YESin step S507), the processing proceeds to step S508. In step S508, theverification apparatus 109 generates correct answer images by averagingthe pixel values of pixels located at corresponding positions on theplurality of printed pages. The processing ends.

If, in step S507, some of the read images are not accepted for use ascorrect answer images (NO in step S507), the processing proceeds to stepS509. In step S509, the verification apparatus 109 determines whether aselection is made to obtain additional images on the UI screen. If theselection to obtain additional images is made (YES in step S509), theprocessing proceeds to step S501. If not (NO in step S509), theprocessing proceeds to step S508. The display of the UI screen in stepS509 will be described below with reference to FIGS. 11A and 11B.

FIG. 6 is a flowchart illustrating a procedure performed by theverification apparatus 109 in performing verification processing. Aprogram for performing the flowchart of FIG. 6 is stored in the memory239 and executed by the CPU 238 of the verification apparatus 109.

In step S601, the verification apparatus 109 determines whether averification end instruction is received. If a verification end button1303 in FIG. 13 is selected, the determination of step S601 is YES. If,in step S601, the verification end instruction is received (YES in stepS601), the processing of the verification apparatus 109 ends. If, stepS601, no verification end instruction is received (NO in step S601), theprocessing proceeds to step S602.

In step S602, the verification apparatus 109 determines whether a sheetis conveyed to the verification apparatus 109. If no sheet is conveyedin step S602 (NO in step S602), the processing proceeds to step S601.If, in step S602, a sheet is determined to be conveyed (YES in stepS602), the processing proceeds to step S603. In step S603, theverification apparatus 109 reads images on the sheet by using the CISs331 and 332 and stores the read images in the memory 239 of theverification apparatus 109. The images stored here are displayed in adisplay section 1301 of FIG. 13.

In step S604, the verification apparatus 109 compares the images read instep S603 with the correct answer images. The correct answer images arebased on settings registered in the verification apparatus 109 by usinga button 703 of FIG. 7. The items to be compared in step S604 include averification level set in a setting section 1201 of FIG. 12 and averification type set in a setting section 1202 in FIG. 12. In stepS605, the verification apparatus 109 determines whether the read imagesare normal images or defective images based on the result of thecomparison made with the correct answer images in step S604. In theprocessing of step S605, the verification apparatus 109 determineswhether the read images have image quality satisfying that of thecorrect answer images.

If, in step S605, the read images are determined to be normal images(verification success) (YES in step S605), the processing proceeds tostep S606. In step S606, the verification apparatus 109 displays thatthe verification result is “passed” on the display unit 241 of theverification apparatus 109. FIG. 13 illustrates an example of the screendisplayed in step S606.

In step S607, the verification apparatus 109 instructs the printer 107to discharge the printed sheet to the stacking tray 341 of the largecapacity stacker 110. The discharge destination to which the sheet isdischarged here is the discharge destination set in a setting section1503 in FIG. 15. Based on the instruction from the verificationapparatus 109, the printer 107 instructs the large capacity stacker 110to discharge the sheet to the stacking tray 341. The processing proceedsto step S601 to continue.

In step S605, if at least either one of the read images is determined tobe a defective image (verification failure) (NO in step S605), theprocessing proceeds to step S608. In step S608, the verificationapparatus 109 displays that the verification result is “failed” on thedisplay unit 241 of the verification apparatus 109. FIG. 14 illustratesan example of the screen displayed in step S608. In step S609, theverification apparatus 109 instructs the printer 107 to discharge theprinted sheet to the escape tray 346 of the large capacity stacker 110.The discharge destination to which the sheet is discharged here is thedischarge destination in the case of verification failure, set in thesetting section 1503 in FIG. 15. Based on the instruction from theverification apparatus 109, the printer 107 instructs the large capacitystacker 110 to discharge the sheet to the escape tray 346. Theprocessing proceeds to step S601 to continue.

FIGS. 7 to 15 illustrate examples of display screens (UI screens)displayed on the display unit 241 of the verification apparatus 109. Thedisplay screens are displayed based on instructions from the CPU 238 ofthe verification apparatus 109.

FIG. 7 illustrates an example of the screen displayed on the displayunit 241 of the verification apparatus 109 when the verificationapparatus 109 is activated. A display section 701 displays a messagethat no correct answer image is registered, and correct answer imagesare to be registered to start verification. If correct answer imageshave been registered, the display section 701 displays a message thatverification can be started. A display section 702 displays a registeredcorrect answer image. In FIG. 7, the display section 702 displays theabsence of registration, since no correct answer image is registered.The display section 702 may display information about a verificationsetting, such as a separator sheet setting, aside from correct answerimages.

The button 703 is intended to call a correct answer image registrationscreen. Correct answer images are images to be compared with images readby the verification apparatus 109. Images obtained by reading printedsheets determined to be normal in advance by visual observation or bythe verification apparatus 109 are used as the correct answer images. Abutton 706 is intended to call a verification setting screen.Verification items and verification precision (the degree of differencefrom the correct answer images beyond which read images are determinedto be defective images) are set according to the user's verificationpurpose. A button 707 is intended to give an instruction to startverification. If verification is started, the verification apparatus 109starts verifying images of conveyed sheets (sheet images).

FIG. 8 illustrates an example of the screen displayed on the displayunit 241 of the verification apparatus 109 in registering correct answerimages. The display screen of FIG. 8 is displayed when the button 703 ofFIG. 7 is selected. A setting section 801 is intended to set the numberof sheets per copy of the print job to be verified. If the number ofsheets per copy of the print job to be verified is two or more, theverification apparatus 109 can register a plurality of images as correctanswer images on each side.

A setting section 802 is intended to set the side(s) to be verified.Whether the verification apparatus 109 verifies both sides, or only thefront or the back, can be set. Even if a sheet is printed only on oneside, both sides can be set to be verified to see the absence of dust onthe unprinted side. A setting section 803 can set how many sheet imagesare obtained to generate an averaged correct answer image. A button 804is intended to give an instruction to register correct answer images.After the button 804 is pressed, the verification apparatus 109 readsimages of conveyed sheets on which the correct answer images areprinted, and registers the read images or averaged images as correctanswer images. Here, the client PC 103 may transmit the correct answerimage data to the external controller 102 and correct answer imagesprinted by the printer 107 may be read by the verification apparatus109. Sheets on which the correct answer images are printed may beinserted from the inserter 108 and read by the verification apparatus109.

FIG. 9 illustrates an example of the screen displayed on the displayunit 241 of the verification apparatus 109 during reading of correctanswer images. The screen illustrated in FIG. 9 is displayed when thebutton 804 of FIG. 8 is pressed. This screen is displayed until as manysheets as set in the setting sections 801 and 803 are read. A button 901is intended to give an instruction to stop the reading of the correctanswer images. If the button 901 is pressed, the display screen returnsto that of FIG. 7 without registering a correct answer image.

FIG. 10 illustrates an example of the screen displayed on the displayunit 241 of the verification apparatus 109 after the reading of thecorrect answer images is completed. A display section 1001 displays apreview image of a printed sheet read by the verification apparatus 109.If there is a plurality of preview images, the displayed image isswitched by using switch buttons 1002. If both front and back sides areverified, the sides can be switched by using a switch button 1003. Tocheck the read image for dust and streaks, image zoom in/out buttons1004 are used to observe the entire image and details for dust andstreaks. After the image is enlarged, the display area can be moved byoperating move image buttons 1009. The operation buttons 1002, 1003,1004, and 1009 are just examples, and such operations may be assigned togesture operations like a flick, pinch, and swipe, without displayingthe operation buttons 1002, 1003, 1004, and 1009.

A button 1005 is intended to give an instruction to use the currentlydisplayed image as a candidate image of a correct answer image after theread image in the display section 1001 is observed. A correct answerimage is generated by calculating averages of the pixel values of pixelslocated at corresponding positions in a plurality of obtained imagesthat are selected to be used by pressing the button 1005. A button 1006is intended to give an instruction not to use the currently displayedimage as a candidate image of a correct answer image, i.e., not to usethe currently displayed image in the averaging processing. An obtainedimage for which the button 1006 is pressed is simply discarded and notused to generate a correct answer image. If only one image is selectedto be used as a correct answer image, the selected image is registeredas a correct answer image. If a plurality of images is selected to beused as a correct answer image, a main image may be selected from theplurality of selected images, and the processing for generating acorrect answer image may be performed with a higher weight on theselected main image.

A button 1007 is intended to give an instruction to simultaneously useall the obtained images as a correct answer image. A button 1008 isintended to give an instruction to discard all the obtained images andnot to use any of the obtained images to generate a correct answerimage. If the button 1007 is pressed or if the button 1005 or 1006 hasbeen selected for each of the obtained images, the display screenproceeds to that of FIG. 11A.

FIG. 11A illustrates an example of the screen displayed afterregistration of a correct answer image or images. Unlike the displayscreen of FIG. 7 before the registration of the correct answer image(s),the display section 701 displays a message that the correct answerimage(s) have been registered. The display section 702 displays aregistered correct answer image. The correct answer image displayed hereis generated by averaging the pixel values of pixels located atcorresponding positions in a plurality of sheet images read by the CISs331 and 332.

A button 1101 is intended to clear the registered correct answerimage(s). If the correct answer image(s) is/are cleared, the displayscreen returns to that of FIG. 7. A button 1102 is intended to registeradditional correct answer images. Suppose that some of the obtainedimages are discarded on the screen of FIG. 10 and the user wants toobtain additional correct answer image candidates. In such a case,additional correct answer image candidates can be obtained by pressingthe button 1102. If the button 1102 is pressed, the display screenproceeds to that of FIG. 11B.

FIG. 11B illustrates an example of a screen for making settings aboutthe registration of additional correct answer images. An additional pagespecification section 1107 is a section for specifying an additionalpage to be obtained. An individual page addition button 1108 is a buttonfor giving an instruction to obtain an additional page specified in theadditional page specification section 1107. An all page simultaneousaddition button 1103 is a button for giving an instruction tosimultaneously additionally obtain all the pages. A display section 1104displays the page(s) to be additionally obtained, specified by using thebutton 1108 or 1103. An additional image number specification section1105 is a section for specifying how many images are obtained for eachpage specified to be additionally obtained. A start obtaining button1106 is a button for starting to obtain additional images. If the startobtaining button 1106 is pressed and the specified number of images hasbeen obtained, the display screen proceeds to that of FIG. 10.

FIG. 12 illustrates an example of the screen displayed on the displayunit 241 of the verification apparatus 109 in making verificationsettings. The display screen of FIG. 12 is displayed when the button 706of FIG. 7 is pressed. The setting section 1201 is intended to set averification level. The verification precision can be changed by thesetting in the setting section 1201. The higher the verification level,the smaller the difference between a correct answer image and a readimage beyond which the verification apparatus 109 determines the readimage to be a defective image.

The setting section 1202 is intended to set a verification type.Verification items can be set according to the user's verificationpurpose. FIG. 12 illustrates that the position, color, streaks, andomission are the items to be verified, and the density is not. Theverification type according to the present exemplary embodiment is justan example.

FIG. 13 illustrates an example of the screen displayed on the displayunit 241 of the verification apparatus 109 after a start ofverification. The display screen of FIG. 13 is displayed when the button707 of FIG. 7 is pressed. The display section 1301 displays the image ofthe printed sheet last read by the verification apparatus 109. A displaysection 1302 displays the determination result obtained by comparing theread image in the display section 1301 with its correct answer image. Inthe example of FIG. 13, the display section 1302 displays “passed”because the read image is determined to be a normal image. Theverification end button 1303 is a button for giving an instruction toend the verification. If the verification end button 1303 is pressed,the verification apparatus 109 ends the verification processing, and thedisplay screen returns to that of FIG. 7.

FIG. 14 illustrates an example of a screen when the last read image isdetermined to be a defective image. Since the read image displayed inthe display section 1301 is compared with the correct answer image anddetermined to be a defective image, the display section 1302 displays“failed”, as well as the factor from which the read image is determinedto be failure and the position thereof. FIG. 14 illustrates that theread image is determined to be a defective image because a streak 1405is detected.

FIG. 15 illustrates an example of a verification job setting screendisplayed on the display 212 of the external controller 102. While FIGS.7 to 14 illustrate examples of the screens in making verificationsettings on the verification apparatus 109, instructions to transmitprinted sheets of correct answer images and printed sheets to beverified to the verification apparatus 109 are issued from the externalcontroller 102. Such verification job settings may be made from thedisplay unit 241 of the verification apparatus 109 instead.

A setting section 1501 is intended to set the number of copies in a job.In FIG. 15, the job is set to be printed in 1000 copies. In the exampleof FIG. 15, a single copy includes one page, and a single job includes1000 pages. In another example, a single copy may include a plurality ofpages. The setting section 1503 is intended to set the dischargedestination of the job for verification (hereinafter, referred to as averification job). Here, the large capacity stacker 110 is set as thedischarge destination, and the escape tray 346 is set as the dischargedestination in a case where the read image is determined to be adefective image by the verification (verification failure). Aside fromsuch settings, the same tray may be set as the discharge destinations inthe cases of both verification success and verification failure. In sucha case, printed sheets of verification failure are manually removedafterward based on a not-illustrated list of verification results.Alternatively, if all sheets are discharged to the same tray, printedsheets of verification success and printed sheets of verificationfailure may be discharged to different positions, and the printed sheetsof verification failure may be removed afterward.

A display section 1504 and a button 1505 are intended to give aninstruction to print N copies of the verification job. If the userinstructs the verification apparatus 109 to start registering correctanswer images from the button 804 of FIG. 8 and then gives aninstruction to print N copies of the verification job using the displaysection 1504 and the button 1505 of the external controller 102, theprinter 107 performs print processing and the verification apparatus 109reads the correct answer images. Alternatively, the verificationapparatus 109 may be configured to automatically issue an instruction toprint N copies of the verification job to the external controller 102via the communication cable 254 and the internal LAN 105 at the sametime as when the button of the setting section 803 of FIG. 8 is pressed.Similarly, the verification apparatus 109 may be configured to issue aninstruction to additionally print a specific page or pages to theexternal controller 102 at the same time as when the button 1106 ispressed in obtaining additional correct answer images as described withreference to FIGS. 11A and 11B.

A button 1508 is intended to give an instruction to start printing theverification job. If the instruction to start printing is given byselection of the button 1508, the external controller 102 submits theverification job to the printer 107 based on the settings of FIG. 15.The user instructs the verification apparatus 109 to start verificationby selecting the button 707 of FIG. 7, and then instructs the externalcontroller 102 to start printing the verification job by using thebutton 1508. The external controller 102 thus submits print data to theprinter 107, and instructs the printer 107 to convey printed sheets tothe verification apparatus 109. The verification apparatus 109 readsimages of the printed sheets conveyed thereto, and performs theverification processing. Alternatively, the external controller 102 maybe configured to instruct the verification apparatus 109 to startverification when the external controller 102 is instructed to startprinting the verification job by the pressing of the button 1508. Insuch a case, the verification apparatus 109 may be configured to notifythe external controller 102 whether correct answer images areregistered, so that the external controller 102 does not start printingif no correct answer image is registered.

As described above, according to the present exemplary embodiment,images read by the CISs 331 and 332 during registration of correctanswer images can be previewed on the UI screen. This enables the userto determine whether to use the printed correct answer images as correctanswer image candidates not only by visually observation of the printedsheets but also by checking whether the correct answer images arecorrectly read by the CISs 331 and 332.

Second Exemplary Embodiment

The first exemplary embodiment can provide a preview display on the UIscreen in registering correct answer images, and the user can check byhimself/herself whether the correct answer images are correctly read.However, previewing and checking all the correct answer images forreading failures due to streaks caused by paper dust is troublesome tothe user.

In the present exemplary embodiment, the occurrence of a reading failureis detected by image processing during reading of the correct answerimages by the CISs 331 and 332. Correct answer images from which areading failure is detected are automatically excluded from a previewdisplay. An apparatus for facilitating registration of correct answerimages by the user can thus be constructed.

Details of an exemplary embodiment of such an apparatus will bedescribed below. A description of configurations and processes similarto those of the first exemplary embodiment will be omitted, and onlythose unique to the present exemplary embodiment will be described.

In the present exemplary embodiment, the procedure of the verificationapparatus 109 in registering correct answer images is different fromthat of FIG. 6 described in the first exemplary embodiment. FIG. 16illustrates the procedure of the verification apparatus 109 inregistering correct answer images according to the present exemplaryembodiment. FIG. 16 is a flowchart illustrating the procedure performedby the verification apparatus 109 in performing verification processing.A program for performing the flowchart of FIG. 16 is stored in thememory 239 and executed by the CPU 238 of the verification apparatus109.

In step S1601, the verification apparatus 109 obtains print settings. Asillustrated in FIG. 17, the print settings obtained in step S1601include the number of sheets per copy, the side(s) to be verified, andthe number of images per sheet to be averaged to generate a correctanswer image. Whether to automatically exclude a read image including astreak from the registration of correct answer images can also be set.When fed back from step S1610 to be described below, the number ofsheets to be printed is determined based on the number of read imagesalready set to be used in step S1610. The number of sheets to be printedis the same as the number of registered correct answer images that lack.In the following description, suppose that there is a setting toautomatically exclude read images including a streak from registrationcandidates of correct answer images. Without the setting to exclude, thesecond exemplary embodiment is similar to the first exemplaryembodiment.

In step S1602, the verification apparatus 109 waits until a sheet isconveyed to the verification apparatus 109. If a sheet is conveyed instep S1602 (YES in step S1602), the processing proceeds to step S1603.In step S1603, the verification apparatus 109 reads the images on thesheet by using the CISs 331 and 332, and stores the read images in thememory 239 of the verification apparatus 109. In step S1604, theverification apparatus 109 applies defective image detection processingto the read images stored in the memory 239 to generate defectinformation. Examples of defects to be detected by the defective imagedetection processing include a stray streak and a fixed streak due topaper dust. FIG. 20A illustrates an example of an image including astray streak. FIG. 20B illustrates a vertical line in a document.Conventional techniques can be used as an algorithm for detecting astray streak. For example, filtering processing is applied to the readimage to detect vertical lines with expected streak widths. Next, theamounts of change in the brightness values of the detected verticallines from nearby pixels in the main scanning direction and the amountsof change in the brightness values of the detected vertical lines fromnearby pixels in the sub scanning direction are calculated. Whether apixel belongs to a streak can be determined from the calculations andcontinuity to the sub scanning direction.

FIG. 18 illustrates a table for managing the defect information. Thedefect information includes a flag managed for each read image. The flagis set to 1 if the image includes a streak occurring from paper powderduring reading. However, this is just an example. A flag may be providedfor each piece of image information by utilizing a header area of theimage information.

Return to the description of FIG. 16. In step S1605, the verificationapparatus 109 obtains the defect information about the read images, anddetermines whether the read images are defective images. If at leasteither one of the read images is a defective image (YES in step S1605),the processing proceeds to step S1607. If the read images are notdefective images (NO in step S1605), the processing proceeds to stepS1606. In step S1606, the verification apparatus 109 generates previewimages for previewing the images read in step S1603 on the display unit241 of the verification apparatus 109. In step S1607, the verificationapparatus 109 determines whether images have been read as many as thenumber of sheets obtained in step S1601. If, in step S1607, images havenot been read as many as the number of sheets yet (NO in step S1607),the processing proceeds to step S1602.

In step S1608, the verification apparatus 109 generates an UI screenincluding a preview image generated in step S1606, and displays the UIscreen on the display unit 241. Details of the UI screen displayed herewill be described below with reference to FIG. 19. In step S1609, theverification apparatus 109 determines whether the verification apparatus109 is instructed from the UI screen whether all the read images can beused as correct answer images. If the verification apparatus 109 isinstructed whether all the read images can be used (YES in step S1609),the processing proceeds to step S1610. If not (NO in step S1609), theprocessing proceeds to step S1609.

In step S1610, the verification apparatus 109 determines whether thenumber of read images set to be used on the UI screen reaches the numberof correct answer images to be obtained. If the number of read imagesset to be used reaches the number of correct answer images to beobtained (YES in step S1610), the processing proceeds to step S1611. Instep S1611, the verification apparatus 109 generates correct answerimages by averaging the read images. The processing ends. If, in stepS1610, the number of read images set to be used does not reach thenumber of correct answer images to be obtained (NO in step S1610), theprocessing proceeds to step S1601. While the processing is described toproceed to the procedure for printing as many additional images aslacking based on the determination in step S1610, the procedure may bemodified so that lacking images are additionally printed immediatelyafter a read image is determined to be a defective image in step S1605.Moreover, print products determined to be defective by the defectiveimage detection processing may be controlled to be output to a differentdischarge tray from print products determined to be normal. Thisenhances the correlation with preview images to be described below thatare displayed to specify whether the read images can be used, andenables more intuitive understanding.

FIG. 19 illustrates an example of a screen displayed on the display unit241 of the verification apparatus 109 after the completion of reading ofcorrect answer images. A display section 1900 displays preview images ofprinted sheets read by the verification apparatus 109. The imagesdisplayed here are different from ones displayed in the first exemplaryembodiment in that images determined to be defective images by thedefective image detection processing are excluded. Here, the displaysection 1900 displays preview images 1901, 1902, and 1903. While thedisplay section 1900 is configured to be able to simultaneously displaythree preview images as an example, this is not restrictive. The previewimage 1901 is that of the first copy of the print product. The previewimage 1902 is that of the second copy of the print product. The previewimage 1903 is that of the fourth copy of the print product. In thisexample, the third copy of the print product is determined to include adefective image due to the occurrence of a stray streak during reading.An information display section 1910 displays information about the readimage automatically excluded from the correct answer image candidates bythe defective image detection processing.

Instruction buttons 1904 to 1909 are intended for the user to, afterchecking the preview images in the display section 1900, specify whetherto use the read images corresponding to the currently displayed previewimages as correct answer image candidates. The instruction buttons 1904and 1905 are intended to specify whether to use the read imagecorresponding to the preview image 1901 as a correct answer imagecandidate. The instruction buttons 1906 and 1907 are similar buttons forthe preview image 1902, and the instruction buttons 1908 and 1909 aresimilar buttons for the preview image 1903. If the instruction buttons(to-use buttons) 1904, 1906, and/or 1908 are pressed, the correspondingread images are averaged to generate a correct answer image. If theinstruction buttons (not-to-use buttons) 1905, 1907, and/or 1909 arepressed, the corresponding read images are simply discarded and not usedas a correct answer image. If neither of the to-use and not-to-usebuttons on a read image is pressed, the read image is handled based on adefault setting (for example, to be used) in generating a correct answerimage.

If the usage of all the displayable preview images is specified, thedisplay screen proceeds to that of FIG. 11A. While FIG. 19 illustratesthe read correct answer image candidates one by one, an averaged correctanswer image may be displayed for observation. Both the correct answerimage candidates and the averaged correct answer image may be displayedfor observation.

As described above, according to the present exemplary embodiment, thedefective image detection processing is performed on the images read bythe CISs 331 and 332 during registration of correct answer images, anddefective images occurring during reading can be excluded from previewimages. This can reduce the user's time and effort for observation.

Other Embodiments

Embodiment(s) of the disclosure can also be realized by a computer of asystem or apparatus that reads out and executes computer executableinstructions (e.g., one or more programs) recorded on a storage medium(which may also be referred to more fully as a ‘non-transitorycomputer-readable storage medium’) to perform the functions of one ormore of the above-described embodiment(s) and/or that includes one ormore circuits (e.g., application specific integrated circuit (ASIC)) forperforming the functions of one or more of the above-describedembodiment(s), and by a method performed by the computer of the systemor apparatus by, for example, reading out and executing the computerexecutable instructions from the storage medium to perform the functionsof one or more of the above-described embodiment(s) and/or controllingthe one or more circuits to perform the functions of one or more of theabove-described embodiment(s). The computer may comprise one or moreprocessors (e.g., central processing unit (CPU), micro processing unit(MPU)) and may include a network of separate computers or separateprocessors to read out and execute the computer executable instructions.The computer executable instructions may be provided to the computer,for example, from a network or the storage medium. The storage mediummay include, for example, one or more of a hard disk, a random-accessmemory (RAM), a read only memory (ROM), a storage of distributedcomputing systems, an optical disk (such as a compact disc (CD), digitalversatile disc (DVD), or Blu-ray Disc (BD)™), a flash memory device, amemory card, and the like.

While the disclosure has been described with reference to exemplaryembodiments, it is to be understood that the disclosure is not limitedto the disclosed exemplary embodiments. The scope of the followingclaims is to be accorded the broadest interpretation so as to encompassall such modifications and equivalent structures and functions.

This application claims the benefit of Japanese Patent Application No.2019-195552, filed Oct. 28, 2019, which is hereby incorporated byreference herein in its entirety.

What is claimed is:
 1. An image forming apparatus comprising: a printingunit configured to print an image on a recording sheet; a reading unitconfigured to read the image printed on the recording sheet; a detectionunit configured to detect a defective image from among images read bythe reading unit; a display control unit configured to display on adisplay unit the images read by the reading unit excluding the defectiveimage detected by the detection unit; an acceptance unit configured toaccept an instruction to use an image displayed on the display unit bythe display control unit as a correct answer image; a registration unitconfigured to register the image that the instruction to use is acceptedby the acceptance unit or an image generated from the image as thecorrect answer image; and a verification unit configured to verify animage printed by the printing unit by comparing the printed image withthe correct answer image registered by the registration unit.
 2. Theimage forming apparatus according to claim 1, wherein the acceptanceunit is configured to accept an image not to be used as the correctanswer image from among the images displayed on the display unit by thedisplay control unit.
 3. The image forming apparatus according to claim1, wherein the registration unit is configured to register an imagegenerated from a plurality of images that the instruction to use isaccepted by the acceptance unit as the correct answer image.
 4. Theimage forming apparatus according to claim 3, wherein the registrationunit is configured to register a correct answer image generated bycalculating an average of pixel values of pixels located atcorresponding positions in the plurality of images.
 5. The image formingapparatus according to claim 1, the reading unit is a contact imagesensor (CIS).
 6. The image forming apparatus according to claim 1,wherein the verification unit is configured to determine image qualityof the image printed by the printing unit.
 7. The image formingapparatus according to claim 1, wherein the printing unit is configuredto print an additional image on the recording sheet based on a number ofdefective images detected by the detection unit, the reading unit isconfigured to read the image printed on the recording sheet, the displaycontrol unit is configured to display the image read by the reading uniton the display unit, and the acceptance unit is configured to accept animage to be used as the correct answer image.
 8. The image formingapparatus according to claim 2, wherein the printing unit is configuredto print an additional image on the recording sheet based on a number ofimages accepted not to be used as the correct answer image by theacceptance unit, the reading unit is configured to read the imageprinted on the recording sheet, the display control unit is configuredto display the image read by the reading unit on the display unit, andthe acceptance unit is configured to accept an image to be used as thecorrect answer image.
 9. An image forming apparatus comprising: aprinting unit configured to print an image on a recording sheet; areading unit configured to read the image printed on the recordingsheet; a display control unit configured to display a plurality ofimages read by the reading unit on a display unit; an acceptance unitconfigured to accept an instruction to use at least one of the pluralityof images displayed on the display unit by the display control unit as acorrect answer image or an instruction not to use the at least one imageas the correct answer image; a registration unit configured to registerthe at least one image that the instruction to use is accepted by theacceptance unit or an image generated from the at least one image as thecorrect answer image; and a verification unit configured to verify animage printed by the printing unit by comparing the printed image withthe correct answer image registered by the registration unit.
 10. Animage forming method comprising: printing an image on a recording sheet;reading the image printed on the recording sheet; detecting a defectiveimage from among read images; displaying the read images excluding thedetected defective image on a display unit; accepting an instruction touse an image displayed on the display unit as a correct answer image;registering the image that the instruction to use is accepted or animage generated from the image as the correct answer image; andverifying a printed image by comparing the printed image with theregistered correct answer image.
 11. An image forming method comprising:printing an image on a recording sheet; reading the image printed on therecording sheet; displaying a plurality of read images on a displayunit; accepting an instruction to use at least one of the plurality ofimages displayed on the display unit as a correct answer image or aninstruction not to use the at least one image as the correct answerimage; registering the at least one image that the instruction to use isaccepted or an image generated from the at least one image as thecorrect answer image; and verifying a printed image by comparing theprinted image with the registered correct answer image.
 12. Anon-transitory storage medium storing a program for causing a computerto function as the units of the image forming apparatus according toclaim
 1. 13. A non-transitory storage medium storing a program forcausing a computer to function as the units of the image formingapparatus according to claim 9.